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Abstract 

We report on a search for a CP-violating asymmetry in the charmless hadronic decay B 

-ft'*(892)^7r^, using 9.12 fb^^ of integrated luminosity produced at ^/s = 10.58 GeV and collected 
with the CLEO detector. We find AcpiB K*{892)^tt^) = 0.26t^:||(stat.)t^:^^(syst.), giving 
an allowed interval of [—0.31,0.78] at the 90% confidence level. 
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The Standard Model predicts that CP-violating phenomena are governed solely by the 
single imaginary parameter of the Cabibbo-Kobayashi-Maskawa matrix P] of complex quark 
couplings. The first observations of CP violation in the neutral B system were recently re- 
ported [2], and they have been interpreted widely as induced by B^-B^ mixing. To date, 
direct CP violation has only been observed in the neutral kaon system j^. Direct CP 
violation in a given decay requires contributions from two or more amplitudes which dif- 
fer in both CP- violating (weak) and CP-conserving (strong) phases. In the B system, 
these conditions are expected to be met in some charmless hadronic decays, and direct CP 
violation can occur at sizeable levels, depending on the magnitude of the strong phase dif- 
ference 0, 0] or on the presence of new physics 0. Previous analyses, mainly focusing on 
two-pseudoscalar final states, have not observed direct CP violation in these decays 0,1^. 
In this Report, we present a search for direct CP violation in the vector-pseudoscalar decay 
B i^'*(892)='=7r^. We express the difference between the decay rates for P° — >• i^'*(892)~7r+ 
and P° ir*(892)+7r^ in terms of an asymmetry, Acp-, defined as 

^ i3(P° ^ is:*(892)-7r+) - i3(P° ^ ir*(892)+7r-) 

" i3(P0 ^ ir*(892)-7r+) + B{B^ K*(892)+7r-) ' ^ ' 

We consider both ir*(892)± submodes, ir*(892)± Kgvr^ and K*{SQ2)^ K^ti^ by an- 
alyzing the final states K^n'^h^ and K^h^n^ , where h"^ denotes a charged pion or kaon. 
We perform a maximum likelihood fit in the K^vr^/i^ and K^hr^n'^ Dalitz plots to distin- 
guish B i^*(892)^7r^ from other intermediate resonances or non-resonant three-body 
decays. The CP-averaged branching fraction for B i^*(892)''=7r^ has been measured by 
the Belle and CLEO Collaborations, and the work described in this Report is an 
extension of that previous CLEO analysis. 

The data sample used in this analysis was produced in symmetric e~^e~ collisions at the 
Cornell Electron Storage Ring (CESR) and collected with the CLEO detector in two con- 
figurations, known as CLEO II and CLEO II. V It comprises 9.1 fb~^ of integrated 
luminosity collected on the T{4S) resonance, corresponding to 9.7 x 10^ BB pairs, of which 
6.3 X 10^ were taken with CLEO II. V. An additional 4.4 fb~^ collected below the BB pro- 
duction threshold is used to study non-BB backgrounds. Of this latter luminosity, 2.8 fb~^ 
were collected with CLEO II. V. The response of the experimental apparatus is studied with 
a detailed GEANT-based simulation of the CLEO detector, where the simulated events 
are processed in a fashion similar to data. 

In CLEO II, the momenta of charged particles are measured with a tracking system 
consisting of a six-layer straw tube chamber, a ten-layer precision drift chamber, and a 
51-layer main drift chamber, all operating inside a 1.5 T superconducting solenoid. The 
main drift chamber also provides a measurement of specific ionization energy loss (dE/dx), 
which is used for particle identification. For CLEO II. V, the six-layer straw tube chamber 
was replaced by a three-layer double-sided silicon vertex detector, and the gas in the main 
drift chamber was changed from an argon-ethane to a helium-propane mixture. Photons 
are detected with a 7800-crystal Csl electromagnetic calorimeter, which is also inside the 
solenoid. Proportional chambers placed at various depths within the steel return yoke of 
the magnet identify muons. 

Charged tracks are required to be well-measured and to satisfy criteria based on the 
track fit quality. They must also be consistent with coming from the interaction point in 
three dimensions. Pions and kaons are identified by consistency with the expected dE/dx, 
and tracks that are positively identified as electrons or muons are not allowed to form the 
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B candidate. We form vr*^ candidates from pairs of photons with invariant mass within 
20 MeV/c^ (approximately 2.5 standard deviations (a)) of the known 7r° mass. These 
candidates are then kinematically fitted with their masses constrained to the known 7r° 
mass. We also require the 7r° momentum to be greater than 1 GeV/c to reduce combinatoric 
background from low-momentum 7r° candidates. Kg candidates are selected from pairs of 
tracks with invariant mass within 10 MeV/c^ or 2.5a of the known Kg mass. In addition, 
K'^ candidates are required to originate from the beam spot and to have well-measured 
displaced decay vertices. 

We identify B meson candidates by their invariant mass and the total energy of their 
decay products. We calculate a beam-constrained mass by substituting the beam energy 

(Eb) for the measured B candidate energy: M = \J El — p^, where is the B candidate 
momentum. Performing this substitution improves the resolution of M by one order of 
magnitude, to about 3 MeV/c^. We define = Ei + E2 + E^ — Eb, where Ei, E2, and E3 
are the energies of the B candidate daughters. For final states with a Kg and two charged 
tracks, the AE resolution is about 20 MeV for CLEO II and 15 MeV for CLEO II. V. A 7r° 
in the final state degrades this resolution by approximately a factor of two. AE is always 
calculated assuming the h"^ is a pion. Therefore, the AE distribution for pions is centered 
at zero, while that for kaons is shifted by at least —40 MeV. We accept B candidates with 
M between 5.2 and 5.3 GeV/c^ and with \AE\ less than 300 MeV for K^h^-n^ and 200 
MeV for K^n^h"^ . This region includes the signal region and a high-statistics sideband for 
background normalization. We reject candidates that are consistent with the exclusive 6 — >■ c 
transitions B Dn, where D — >■ Kir, and B — >■ ipK^, where ip — > and the muons are 

misidentified as pions. 

The main background in this analysis arises from e~^e~ — > qq, where q = u, (Ls, c. To 
suppress this background, we calculate the angle ^sph between the sphericity axis M of the 
tracks and showers forming the B candidate and that of the remainder of the event. Because 
of their two-jet structure, continuum qq events peak strongly at |cos6'sph| = 1, while the 
more isotropic BB events are nearly flat in this variable. By requiring | cos^sphl < 0.8, we 
reject 83% of the continuum background while retaining 83% of signal B decays. Additional 
separation of signal from qq background is provided by a Fisher discriminant |15] formed 
from eleven variables: the angle between the spheri city axis of the candidate and the beam 
axis, the ratio of Fox- Wolfram moments H2/H0 [16|, and the scalar sum of the visible 
momentum in nine 10° angular bins around the candidate sphericity axis. In the likelihood 
fit, we also make use of the angle between the B candidate momentum and the beam axis, 
Ob- Angular momentum conservation causes B mesons produced through the T(4S') to 
exhibit a sin^ 6b dependence, while candidates from continuum are flat in cosOb- 

In both the KgH^h^ and i^^/i^vr^ topologies, the /i^ refers to the faster of the two 
tracks, which typically has momentum above 1 GeV/c. Because dE/dx still provides limited 
separation of pions and kaons above 1 GeV/c, we make use of the dE/dx information in 
the likelihood fit. In B ^ K*{892)^tt^ decays, this higher-momentum track is the one that 
recoils from the K*{892)^, more than 99.99% of the time. Its charge uniquely distinguishes 
B^ i^*(892)~7r+ from _B° _ft'*(892)+7r". Thus, the charge asymmetry A+-, formed 
using the charge of this higher-momentum track, is essentially the same as Acp- 

Our loose selection criteria result in samples consisting primarily of background events 
and containing 11893 candidates for K^ir^h^ and 28589 for K^h'^n^. To extract yields and 
CP asymmetries, we perform an unbinned maximum likelihood fit using the observables M, 
AE, JF, cos6b, the two Dalitz plot variables in each topology, and the dE/dx of the h"^ 



4 



(the faster of the two primary tracks). At high momentum, charged pions and kaons are 
statistically separated by their dE/dx and by AE, each of which provides discrimination at 
the 2.0(7 level {1.1a for CLEO II), and we fit for both vr and K hypotheses simultaneously. 
Charged pions and kaons with momentum below 1 GeV/c are cleanly identified by dE/dx 
consistency at the 3a level. The free parameters in the fit are yields (A^) summed over charge 
states, Nh+ + N/^^-, and charge asymmetries, = {Nh+ — Nh-)/{Nh+ + N^-). 

The probability for a candidate to be consistent with a given component is the product 
of the probability density function (PDF) values for each of the input variables (neglecting 
correlations). The likelihood for each candidate is the sum of probabilities over the compo- 
nents in the fit, with relative weights determined by maximizing the total likelihood of the 
sample, which is given by the following expression: 

candidates T components r variables 

>c= n E /.(i±^^) n -p^^^ 

i=l { j=l L k=l 

where the ± refers to the charge of in each candidate. The Vijk are the per candidate 
PDF values, and the fj and are the free parameters optimized by the fit. The products 
fj{l ± A-'^_)/2 are constrained to sum to the fraction of candidates in the fit with the 
appropriate charge of h^. Since the PDFs are normalized to unit integral over the fit domain, 
the fj can be interpreted as component fractions. The parameters of the dE/dx PDFs are 
measured from D K^n^ decays in data. For all other variables, the signal and the 
background b ^ c PDFs are determined from high-statistics Monte Carlo samples, and the 
continuum PDFs are determined from data collected below the BB production threshold. 
The impact of correlations among the input variables is reduced by determining the PDFs 
as a function of the event location in the Dalitz plot, for coarse bins in the M'^{Kti)-M'^{'K'k) 
plane. We use Monte Carlo simulation to estimate the systematic uncertainty associated 
with neglecting any remaining correlations. 

Events from B Kg'K^hr^ and B K'^h^n^, including B — * A'*(892)=^7r'F, are modeled 
in the fit as follows. We consider various B decay channels with intermediate resonances 
(A'*(892), i^'Q(1430), p(770), and /o(980)) as well as non-resonant phase space decay. The 
Dalitz plot PDFs include our knowledge of the helicity structure in these decays. We neglect 
interference among these signal processes and assign a systematic uncertainty estimated from 
Monte Carlo simulation. The decays B )C^h^, where denotes K*{892)^ or K^{U30)^, 
are accessible through different /C^ submodes in both the Kgir^h"^ and K^h^n^ topologies. 
To maximize our sensitivity to these decays, we fit these two topologies simultaneously, with 
the branching fraction and charge asymmetry for each JC^h^ decay constrained to be equal 
in its two /C^ submodes, which are related by isospin. 

The charge symmetry of the CLEO detector, the track reconstruction software, and the 
dE / dx measurement has previously been verified 0, 0| . The charge asymmetries of the 
fit samples are 0.010 ± 0.009 for B K^-n^h^ and 0.006 ± 0.006 for B K^N^t:^. 
Detection efficiencies and crossfeed among the charge-summed signal yields are measured 
from Monte Carlo simulated events and are accounted for in the fit for Aj^-. We find the 
charge asymmetry of the detection efficiencies to be consistent with the expected null result. 
Crossfeed among different charge states is not included in the fit, and its effect is estimated 
with Monte Carlo simulation. 

We perform the fit with differing combinations of intermediate resonant and non-resonant 
states, with up to twelve signal components. The fitted value of Acp does not depend heav- 
ily on the number of signal components in the fit, and we include a systematic uncertainty 
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FIG. 1: Likelihood as a function of Acp before (dashed) and after (soUd) including systematic 
uncertainties. The hatched regions each contain 5% of the integrated area in the physical region 
and are excluded at the 90% confidence level. 



for these variations. We also allow for four background components: pion and kaon hy- 
potheses for for continuum background and background from b ^ c decays. We do 
not fit for charge asymmetries in the background components, but we measure them to be 
consistent with zero. The B — iir*(892)^7r^ event yields were measured to be jl^ 12.6l3;9 
for ir*(892)± K'^gTi^ and G.ltH for K*i892)^ K^n^ with a combined statistical sig- 
nificance of 4.6(7. In the fit, these yields are corrected for efficiency and crossfeed from other 



modes, and the CP asymmetry in 5 — > i^'*(892) tt^ is measured to be Acp = 0.26 



-+0.33+0.10 
-•-0.34-0.08) 

where the uncertainties are statistical and systematic, respectively. The dominant contri- 
butions to the latter are statistical uncertainties in the PDFs and variations in the fitting 
method. 

We determine the dependence of the likelihood function on Acp by repeating the fit at 
several fixed values of Acp- By convoluting this function with the systematic uncertainties 
and integrating the resultant curve in the physical region, we construct a 90% confidence 
level interval of —0.31 < Acp < 0.78, where the excluded regions on both sides each contain 
5% of the integrated area. Figure ^ shows the likelihood function given by the fit and the 
effect of including systematic uncertainties. 

In summary, we have measured the CP asymmetry in B ^ i^*(892)''=7r^ using a simul- 
taneous maximum likehhood fit to the B K^ir^h'^ and B K^h^n^ topologies. We 
obtain the value Acp = O-'^Q-o^l-om^ which is consistent with the theoretical predictions 
of -0.19 to 0.47. We also establish a 90% confidence level interval of [-0.31,0.78]. 

We gratefully acknowledge the effort of the CESR staff in providing us with excellent 
luminosity and running conditions. M. Selen thanks the Research Corporation, and A.H. 
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